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Abstract. - Communication networks consume huge, and rapidly growing, amount of energy. 
However, a lot of the energy consumption is wasted due to the lack of global link power coordi- 
nation in these complex systems. This paper proposes several link power coordination schemes to 
achieve energy-efficient routing by progressively putting some links into energy saving mode and 
hence aggregating traffic during periods of low traffic load. We show that the achievable energy 
savings not only depend on the link power coordination schemes, but also on the network topolo- 
gies. In the random network, there is no scheme that can significantly outperform others. In the 
scale-free network, when the largest betweenness first (LBF) scheme is used, phase transition of 
the networks' transmission capacities during the traffic cooling down phase is observed. Motivated 
by this, a hybrid link power coordination scheme is proposed to significantly reduce the energy 
consumption in the scale-free network. In a real Internet Service Provider (ISP)'s router-level 
Internet topology, however, the smallest betweenness first (SBF) scheme significantly outperforms 
other schemes. 
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1 Introduction. — Electricity usage of the data com- 

■ rnunication networks has contributed to a large, and grow- 
^— ^ ing, portion of the overall energy consumption, becoming 

' a major concern for network operators pQ [2] [I] ■ How- 
! L* ever, the lack of global power coordination makes it hard 
1 . £h to achieve highly efficient use of the energy. The net- 
work infrastructure often maintains rich connectivity to 
ensure certain degree of redundancy and robustness to 
- - - oope with peak load or to accommodate future growth, 
which is, however, unnecessary under the circumstance 
of low traffic load. Since a link's energy consumption is 
mainly dominated by its operation states, e.g., active or 
inactive, rather than the carried traffic load [3J, it is very 
inefficient to keep all the links powered on when traffic 
load is low. 

A principle for energy-efficient routing is that the num- 
ber of links kept active should be correlated with the traf- 
fic load, an incarnation of the energy proportionality con- 
cept [17] in the context of routing. Measurements show 
that the Internet backbone traffic exhibits daily periodic- 
ity Qj5]. It starts to rise from around 9:00AM and reaches a 
high level around 2:00PM, then it plateaus until 2:00AM, 
after which it starts to decline. Roughly, the backbone 



traffic stays at the high level for half of the day, and the 
warmup and cooling down phases account for the other 
half day. During the long period of traffic decline (or rise) , 
links can be progressively put into sleep (or woken up) for 
energy conservation. Motivated by this, the pioneer work 
[2] proposed a sleeping scheme that relies on local traffic 
profile to achieve small-scale coordination. 

However, presently there lacks a preliminary knowledge 
of how the number of active links correlates with the traf- 
fic load. This issue becomes more complicated since re- 
searches in the last decade have revealed that the data 
communication networks have heterogenous and complex 
structures, rather than presumably random topologies 
[71 ITM21)] . It is well known that routing on complex net- 
works shows quite different characteristics from routing 
on random networks [SHU El [HI HH1 US]- Consequently, 
different link power coordination schemes may have quite 
different performance on different networks. Hence, for 
the purpose of maximizing the energy savings under pe- 
riodic load variation, it is critical to develop efficient link 
power coordination schemes for various networks and re- 
veal insight into how energy consumption relates to traffic 
load. The authors of [3J proposed a centralized coordina- 
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tion algorithm by formulating it as a mixed-integer opti- 
mization problem, however, the computation complexity 
prevents it to be scaled to large networks. In [33], the 
authors proposed rate adaptation and sleeping strategies 
based on local monitoring of the traffic to save energies. In 
[3 1J , a distributed energy-aware traffic engineering scheme 
is proposed to maximize the energy savings. This work 
bases its coordination decision by solving an optimization 
problem constrained by the traffic demands and link uti- 
lizations, and proposes practical protocol-level detail of 
the traffic engineering. Similar optimization-driven ap- 
proaches with traffic matrices as constraints are also pro- 
posed in [JJIESJESIES]- In [37], a green OSPF protocol is 
proposed to save energy during the low traffic period by 
shutting down some unnecessary links. All these schemes, 
however, are designed for generic networks. They are not 
tailored for different networks for performance improve- 
ment. In comparison, our work leverages the long-term 
traffic periodicity observed by historical traffic profile, and 
focuses on an in-depth investigation of how different net- 
work topologies inherently affect possible energy savings. 
As a result, our work reveals insight into future network 
designing. In addition, our link powerdown schemes are 
centralized algorithms that rely on the historical traffic 
profile and network topologies, which are fast enough to 
be applied to large-scale networks. 

In short, we propose several coordinated link power 
management schemes and analyze the efficiency and ef- 
ficacy in terms of energy savings on several different net- 
work topologies. These schemes rely on macroscopic topo- 
logical properties to enable coordination in large-scale net- 
works. We show that the efficiency and efficacy of different 
schemes depend not only on the schemes themselves, but 
also on the network topologies. In the random network, 
except for the largest betweenness first (LBF) scheme, 
all other schemes have similar performance; in the scale- 
free network, a hybrid scheme performs much better than 
other schemes due to the presence of a phase transition 
of the network's transmission capacity; and in a real ISP's 
router-level topology, the smallest betweenness first (SBF) 
scheme significantly outperforms other schemes. In addi- 
tion to the understanding of the practical network design- 
ing in terms of possible energy savings, this study can also 
provide useful inputs for future energy-aware communica- 
tion network planning and routing protocol development. 

Traffic Flow Model. — In this paper, we adopt a 
traffic flow model that is similar to the model used in 
[ErUEIlUBHSD]. The network is modeled as a graph 
G(V, E), where V and E are the set of nodes and edges 
respectively, with the number of nodes |V| = N and the 
number of edges \E\ = M . Each node is capable of gen- 
crating, forwarding and receiving packets. The shortest 
path routing is used for path selection. When there are 
multiple shortest paths between a node pair, each time 
a random selection is made. Each interface is capable of 
forwarding one packet at a time step to the next hop. 



At each time step, R packets are generated with random 
sources and destinations. When R increases from zero, 
it is expected to observe a phase transition from the free- 
flow phase in which the average number of packets created 
and consumed are equal, to the congested phase in which 
the number of packets created exceeds what the network 
can process in time. The critical packet generating rate is 
denoted as i? c , which can be quantitatively estimated by 
the following equation [SHIMIMMIJ : 



where B max is the maximal edge betweenness |T3j of all 
edges. Here, the edge betweenness B(e) of an edge e is 

defined as B(e) = ^xtij) ' wnerc ^{hj) m the number 
of shortest paths between node i and j, and X^ e '(i,j) is 
the number of shortest paths between node i and j passing 
through edge e. 

In this model, we make a coarse-grained QoS evaluation 
based on the overall network's packet injecting rate R, 
rather than a per source and destination QoS demand. If 
R < R c , we say the QoS is satisfied, whereas if R > R c , 
we say the QoS is violated. There are various other ways 
to evaluate the QoS, for instance, using a threshold value 
a that specifies the maximum utilization of any link in 
the network, i.e., the QoS is satisfied only when all link 
utilizations are below a. In our traffic flow model, these 
two evaluation approaches are tightly correlated. R = R c 
means some links are saturated, i.e., a = 1. In order to 
let a < 1, we can scale R by a factor of a. 

Link Power Coordination Schemes. Starting 
from an original network G, we denote R c of this orig- 
inal network as i?o, and call it as the designed network 
capacity. The designed network capacity will be used as a 
baseline for future quantification of traffic load input, i.e., 
traffic load input will be measured by the percentage of the 
designed network capacity. A coordinated link powerdown 
scheme powers down a sequence of links {h,h, ■■■Ah} to- 
wards a spanning treeQ We denote the corresponding R c 
values of each network after removing U as Ri . We assume 
a symmetric approach for link powering up, i.e., when traf- 
fic demand rises, links are awoken in the reverse order as 
they arc powered down. Therefore, in the following, we 
will only focus on the traffic cooling down phase. 

We introduce several coordinated link powerdown 
schemes during the traffic cooling down phase. The small- 
est betweenness first (SBF) scheme comes from the intu- 
ition that these links carry the least amount of traffic, and 
hence powering down them will not significantly increase 
the traffic burden on other links. The largest between- 
ness first (LBF) scheme arises from the observation that 
the scale-free network's transmission capacity can be sig- 
nificantly enhanced by the removal of a small number of 

1 In order for any node to be able to communicate with any other 
nodes, at least a tree containing M-l links should be kept active. 
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Fig. 1: The R c values after removing network links of the three networks under different link powerdown schemes. 



edges that connect nodes of high bctweenness values . 
The random scheme is included for baseline comparison 
purpose. The detailed descriptions of these schemes are 
listed as follows: 

• Random: this is the simplest scheme which ran- 
domly selects a link and puts it into sleep. 

• SBF: this scheme recursively powers down the link 
that has the smallest edge betweenness in the result- 
ing network. 

• LBF: this scheme recursively powers down the link 
that has the largest edge betweenness in the resulting 
network. 

In all these cases, we ensure that the outcome network 
after each step remains connected. If powering down a 
link makes the network unconnected, we will cancel this 
operation and move to the next link. 

Fig. [T] reports the R c values after links are removed 
under different link powering down schemes of two syn- 
thesized network topologies and a real ISP's router- level 
topology. The two synthesized networks are: the random 
network generated by the ER model [5] [5] , and the scale- 
free network generated by the BA model [7J. The real 
ISP's router-level Internet topology, denoted as AS3967, 
is from AS 3967 measured by the Rocketfule project [57] . 
The synthesized networks are generated with the same size 
as AS3967, each having 353 nodes and 820 edges. We run 
several instances for each kind of the synthesized networks, 
and the results are similar. The results presented here 
are typical instances of those results. It is observed that 
the LBF scheme can increase the R c significantly when 
a small fraction of the links are removed in the BA net- 
work, however, there is a phase transition point around 
which removing additional links can drastically decrease 
the R c . With respect to energy saving, this means a cer- 
tain number of links can be put into sleep when the packet 
generating rate R is smaller than the R c before the phase 
transition, however, after this point, no links can be put 
into sleep, unless R drops below the R c of the network 
after the phase transition, which could be a quite long 
time period. Inspired by this, we propose a fourth scheme 



called Hybrid, in hope that the R c can go down gradu- 
ally rather than abruptly even after the phase transition, 
hence creating more chance for sleeping: 

• Hybrid: this scheme first uses the LBF scheme to 
power down links until the phase transition of R c , 
after which, it switches to the Random scheme. 

The key question in the Hybrid scheme is when to switch 
from the LBF scheme to the Random scheme. We use the 
following heuristic approach to define the phase transition 
point k at which the switching takes place. We define k E 
[1, h] to be the smallest integer that satisfies the following 
two criteria, where h = M — 7V+1 is the maximum number 
of links that can be removed: 

1. R K > R K +j, 3 ' = 1, • • • j I — 1, where I is a window size 
for the number of links removed; 

2- i? K +z-i < 4f-. 

In Fig. [TJ we also plot the Hybrid scheme with I = 20, an 
empirical value for various scale-free networks. It can be 
seen that applying Hybrid scheme in the BA network, the 
phase transition disappears, and R c decreases gradually 
after the corresponding phase transition point in the LBF 
scheme. 

The reason for the occurrence of phase transition in 
the LBF scheme can be expressed in the following way. 
Initially, removing the critical links (i.e., high edge be- 
tweenness links) in scale- free networks can make the traffic 
more balanced in the network, avoid the traffic congestion 
in the busy links, and consequently enhance the overall 
transmission efficiency. However, this effect should come 
under the condition that the path diversity is not signif- 
icantly affected. When certain amount of these critical 
links arc removed, continual removal of these critical links 
will greatly reduce the path diversity between node pairs. 
Lacking of path diversity will make some links unable to 
be bypassed and congestion unable to be avoided. To ana- 
lyze this effect, we use the minimum cut, m c , between any 
node pairs as a measure of path diversity, and plot in Fig. 
[2] the probability distribution of this measure for a wide 
range of networks around the phase transition of the BA 
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network. Note that the minimum cut between two nodes 
defines the upper bound of the number of edge disjoint 
shortest paths between these two nodes. It can be ob- 
served that before the phase transition, recursive removal 
of links with the largest edge betweenness in the BA net- 
work has little impact on the minimum cut between any 
node pairs. However, this property begin to change around 
the phase transition point. Notably, the probability that 
a node pair has only a single edge disjoint path between 
them, i.e., m c =l, increases very quickly after the phase 
transition point. This indicates that around the phase 
transition, the benefit of load balancing arising from the 
removal of critical links begins to fade away, whereas the 
negative effect on the network's path diversity increases 
abruptly when links are continued to be removed in this 
way. 

Fig. [3] also presents the cumulative distribution of edge 
betweenness of the original network, the network with 
maximum R c , several networks around the phase tran- 
sition point, and the final spanning tree of the BA net- 
work. It can be seen that just before the phase transition, 
the distribution of edge betweenness is relatively uniform, 
even more uniform than the original network. This con- 
firms that at the initial stage of the LBF scheme, removing 
critical links can balance the traffic in the network. How- 
ever, after the phase transition, the distribution becomes 
more heavy tailed, reflecting the performance degradation 
of the LBF scheme. 




Fig. 2: The probability distribution of the minimum cut 
between any node pairs for a wide range of networks 
around the phase transition in the BA network. m c repre- 
sents the minimum cut, the A-axis represents the number 
of links being removed by the LBF scheme, and the y-axis 
represents the probability of a node pair whose minimum 
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We also observe clear differences between the real ISP's 
router-level Internet topology and the other two synthe- 
sized networks. One difference is that the designed net- 
work capacity of AS3967 is much smaller than other net- 
works, although their network sizes are the same. This 
effect is also reported in our previous work [5]. Another 
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Fig. 3: The cumulative probability distribution of the edge 
betweenness. Gi means the network derived by removing 
i edges under the LBF scheme. Go is the original network, 
G50 is the network with maximum R c , G175 is the network 
before the phase transition, and G468 is the spanning tree. 



major difference is that with the SBF scheme, all the R c 
values of the two synthesized networks decrease steadily, 
while the R c value of AS3967 decreases very slowly until 
a large portion of the links are removed. On the contrary, 
the LBF scheme performs extremely bad. The above dif- 
ferences indeed all arise from the fact that the router- 
level Internet topology is structured in a more hierarchi- 
cal manner. In the router-level Internet topology, routers 
can be coarsely classified into core routers, edge routers 
and aggregation routers. Aggregation routers account for 
the largest portion of its nodes. Typically they connect 
to access routers, which in turn connect to core routers, 
forming an apparent hierarchical structure. So, different 
aggregation routers that share no common access routers 
have to rely on core routers to reach each other. Hence, 
links between core routers often have very large edge be- 
tweenness, resulting in relatively small designed network 
capacity. In the LBF scheme, these links are the first to 
be removed. However, removing these links cannot make 
the traffic more balanced, but instead, will put more pres- 
sure on the remaining core links, which expresses why the 
LBF scheme performs extremely bad. On the other hand, 
aggregation routers are often connected to multiple access 
routers to improve their robustness for network accessibil- 
ity and to avoid single point of failure. These links are 
provided only for redundancy or backup purposes, which 
have very small edge betweenness values. Consequently, 
removing these links will not affect the network's capacity, 
which expresses why the SBF scheme shows remarkably 
good performance in AS3967. 

Quantitative Measurement of Energy Savings. 

Assuming the packet injecting rate R decreases from 
L-RoJ by one for each time unit until [Rh\, then given a 
link powerdown scheme T, the overall sleeping time units 
SLEEP^ of these links during the traffic cooling down 
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Fig. 4: Correlation between the percentage of active links and the traffic load under different link coordination schemes 
in different networks. The A"-axis is the percentage of traffic load of the designed network capacity, i.e., R c of the 
original network. 



period are: 

SLEEP {r) = max{k\Ri>R,Vie[l,k}} (2) 

R=lR h } 

The potential energy savings can then be measured by 
the ratio between SLEEP^ and the maximal active time 
when all links are active during the whole period, i.e., 
M(|_i?oJ — L^d); where M is the number of links in the 
original network. 

Applying the above analysis, Table [1] presents the aver- 
age achievable energy savings under different coordinated 
link powcrdown schemes for the three networks. We ob- 
served that the LBF scheme performs extremely bad on 
the ER network and AS3967. During the whole traffic 
cooling down phase, the overall achievable energy savings 
are only less than 2% and 4% respectively. On the ER 
network, the other three schemes, Random, SBF and Hy- 
brid, have similar performance. On the BA network, we 
found that the Hybrid scheme performs much better than 
the other three schemes. While on the AS3967, the SBF 
scheme outperforms other schemes significantly. 

Table 1: Percentage of energy savings that can be achieved 
under different link power down schemes on the three net- 
works. 



Network 


Random SBF LBF Hybrid 


ER 
BA 
AS3967 


26.0% 28.6% 1.7% 26.1% 
29.9% 32.9% 24.9% 43.0% 
37.8% 53.6% 3.2% 22.0% 



The achievable energy savings critically depend on the 
correlation between the number of active links and the 
traffic load (measured by the percentage of designed net- 
work capacity). Fig. [4] presents the correlation between 
the two factors. If we treat the percentage of active links 
as a function of the traffic load, we have the following 
observations: 

• With the Random scheme, the percentage of active 



links is an approximately linear function of the traf- 
fic load on the two synthesized networks, whereas a 
weaker linear correlation is observed on AS3967. In 
all cases, nearly all the links have to be kept active 
when the traffic load reaches the designed network 
capacity. 

• The SBF scheme is similar to the Random scheme for 
the two synthesized networks, however, it shows quite 
different performance on AS3967. When applying the 
SBF scheme on AS3967, only a small portion of the 
links have to be kept active for a wide range of traffic 
load. Indeed, in this case, the number of active links is 
a concave function of the traffic load, which is superior 
to both the linear and convex functions in terms of 
energy savings. 

• With the LBF scheme, a large portion of links should 
be kept active for a wide range of traffic load. This 
exact portion is, however, dependent on the network 
topologies. For the ER network and AS3967, even 
with very low traffic load, nearly all the links have to 
be kept active to satisfy the QoS, while for the BA 
network, a constant fraction of the links can be put 
into sleep for a wide range of traffic load. 

• The Hybrid scheme performs similarly to the Ran- 
dom scheme on the ER network, because the phase 
transition always takes place at the very beginning 
of the link powerdown process. In the BA network, 
in addition to enable linear correlation between the 
number of active links and traffic load, the Hybrid 
scheme also requires much fewer links to be kept in 
active state when the traffic load reaches the designed 
network capacity. 

Conclusion and Discussion. In this paper, we 
show that significant energy can be saved if links are in- 
telligently put into sleep during periods of low traffic load. 
Even very simple schemes such as the random link pow- 
erdown scheme can save significant amount of electricity 
usage. Optimized energy savings, however, depend not 
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only on the link coordination schemes, but also on net- 
work topologies. 

We observe both linear and convex relationships be- 
tween the number of active links and the traffic load on 
the two synthesized networks, whereas on AS3967, we 
observe concave relationship between the above two fac- 
tors, a notably good relationship for energy savings. How- 
ever, AS3967 has much smaller designed network capacity 
than the two synthesized networks. From the theoretical 
point of view, it is interesting to investigate whether there 
are network topologies that simultaneously allow high de- 
signed network capacities and concave relationships be- 
tween the number of active links and the traffic load. 

As a theoretical work, several practical issues remain 
to be addressed in order to realize the potential energy 
savings. The first issue is when to power down/ up the 
links in practice? One possible solution is to leverage the 
empirical daily traffic profile to guide the decision. An- 
other important issue is that powering up/down the links 
triggers the routing changes. How these schemes affect the 
routing table changes and end-to-end delays remains to be 
investigated in future practical studies. In practice, those 
schemes that enable similar energy savings but trigger the 
least amount of routing change events should be favored. 
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